Inspection image display control method, inspection image display control apparatus and inspection image display control system

ABSTRACT

A control method for displaying inspection images causes a processor to display an image of a model of an inspection object including a plurality of inspection sites, in a first display region and display first inspection information relevant to at least one inspection site, in a second display region, where the at least one inspection site is selected from the plurality of inspection sites in the image of the model displayed in the first display region. The control method further causes the processor to display inspection information prior to the first inspection information, as second inspection information relevant to the model, in a third display region, concurrently with one or more of the first display region and the second display region.

This application claims benefit of Japanese Application No. 2018-93036filed in Japan on May 14, 2018, the contents of which are incorporatedby this reference.

BACKGROUND OF THE INVENTION 1. Field of the Invention

The present invention relates to an inspection image display controlmethod, an inspection image display control apparatus and an inspectionimage display control system.

2. Description of the Related Art

Conventionally, various apparatuses, various facilities and the like areinspected regularly or irregularly. Inspection data obtained by theinspection is evaluated and recorded by an inspector, and is used forrepair necessity, failure prediction and the like about an inspectionobject.

The inspection object has a complex structure in some cases. Forexample, a turbine system of an electric power plant, an aircraft or thelike has a complex structure, the inspection data includes imageinformation, and data quantity of the inspection data is large.

For example, in International Publication No. 2014/116372, a system forefficiently managing the inspection data is proposed. In the systemaccording to the proposition, for accessing object data from an enormousquantity of data, the inspection data is filtered in association with amodel of the inspection object.

SUMMARY OF THE INVENTION

An inspection image display control method according to an aspect of thepresent invention causes a processor to display an image of a model ofan inspection object including a plurality of inspection sites, in afirst display region, display first inspection information relevant toat least one inspection site, in a second display region, the at leastone inspection site being selected from the plurality of inspectionsites in the image of the model, and display inspection informationprior to the first inspection information, as second inspectioninformation relevant to the model, in a third display region,concurrently with the first display region and the second displayregion.

An inspection image display control apparatus according to an aspect ofthe present invention is an inspection image display control apparatusincluding a processor, the processor being configured to cause a displayapparatus to display an image of a model of an inspection objectincluding a plurality of inspection sites, in a first display region,cause the display apparatus to display first inspection informationrelevant to at least one inspection site, in a second display region,the at least one inspection site being selected from the plurality ofinspection sites in the image of the model, and cause the displayapparatus to display inspection information prior to the firstinspection information, as second inspection information relevant to themodel, in a third display region, concurrently with the first displayregion and the second display region.

An inspection image display control system according to an aspect of thepresent invention is an inspection image display control systemincluding a server and a terminal apparatus, the server including theinspection image display control apparatus according to the aspect, theterminal apparatus including the display apparatus, the server and theterminal apparatus being communicably connected through a network.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a configuration diagram of an inspection image display controlsystem according to an embodiment of the present invention;

FIG. 2 is a block diagram showing a configuration of a server accordingto the embodiment of the present invention;

FIG. 3 is a diagram for describing inspection sites of an inspectionobject, according to the embodiment of the present invention;

FIG. 4 is a diagram showing a folder tree structure of a plurality offolders in which inspection data is stored, according to the embodimentof the present invention;

FIG. 5 is a diagram showing a configuration example of a file name thatincludes evaluation information, according to the embodiment of thepresent invention;

FIG. 6 is a flowchart showing an example of a flow of a process in aterminal apparatus that is used by a user, according to the embodimentof the present invention;

FIG. 7 is a flowchart showing an example of a flow of a process in aserver corresponding to a data request command for the inspection datafrom a tablet terminal, according to the embodiment of the presentinvention;

FIG. 8 is a diagram showing a configuration of an inspection datadisplay screen that is displayed on the tablet terminal based on imagedata received from the server, according to the embodiment of thepresent invention;

FIG. 9 is a diagram showing a specific configuration example of theinspection data display screen, according to the embodiment of thepresent invention;

FIG. 10 is a flowchart showing an example of a flow of a generationprocess for image data in FIG. 7 , according to the embodiment of thepresent invention; and

FIG. 11 is a diagram showing a specific configuration example of aninspection data display screen that contains a fourth display region,according to the embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT(S)

Hereinafter, an embodiment of the present invention will be describedwith reference to the drawings.

(Configuration)

FIG. 1 is a configuration diagram of an inspection image display controlsystem according to the embodiment. Hereinafter, the embodiment will bedescribed using an example in which inspection data includes anendoscope image obtained by inspecting an inspection object with anendoscope apparatus.

An inspection image display control system 1 in the embodiment includesan endoscope apparatus 2, and a server 5 that is connected through anetwork 3. The network 3 includes an internet 3 a.

The endoscope apparatus 2 includes an elongated insertion portion 2 a,and can display an endoscope image on a monitor 2 b. The endoscope imageis acquired through an observation window provided at a distal endportion of the insertion portion 2 a.

A user that is an inspector can perform inspection of an inspectionobject 4 by inserting the insertion portion 2 a of the endoscopeapparatus 2 into the inspection object 4 and watching the endoscopeimage of an interior of the inspection object 4.

Furthermore, the user can record the inspection data including theendoscope image, in a storage medium 2 c such as a memory card. Thestorage medium 2 c is detachable from the endoscope apparatus 2. Theuser can record both a still image and a moving image in the storagemedium 2 c, as the image of the interior of the inspection object.

The user can upload the inspection data obtained by the inspection, to aserver 5 on a cloud 5 a. When a communication function is provided inthe endoscope apparatus 2, the user, using the communication function,can upload the inspection data recorded in the storage medium 2 c fromthe endoscope apparatus 2 to the server 5.

Note that the user may upload the inspection data including theendoscope image, to the server 5, by attaching the storage medium 2 c inwhich the inspection data is recorded to an unillustrated personalcomputer (hereinafter, referred to as a PC).

The inspection data includes a serial number of the inspection object,an inspection date, a plurality of endoscope images, and informationrelevant to the respective endoscope images, and is stored in a storageapparatus of the server 5, together with an inspection identifier(hereinafter, referred to as an inspection ID). The server 5 exists onthe so-called cloud 5 a, and the user such as the inspector can uploadthe inspection data to the server 5 on the cloud 5 a, and can performcheck and edit of the inspection data, creation of the inspectionreport, and the like.

FIG. 2 is a block diagram showing a configuration of the server 5.

The server 5 includes a processor 11, a storage apparatus 12 and acommunication unit 13. The processor 11 includes hardware circuits suchas a central processing unit (hereinafter, referred to as a CPU), a ROMand a RAM.

Note that the processor 11 may include hardware such as a FPGA (fieldprogrammable gate array), instead of the CPU or separately from the CPU.

The storage apparatus 12 stores various software programs. Each softwareprogram is read and executed by the CPU of the processor 11.

Note that all or some of the various programs may be stored in the ROMof the processor 11.

In the storage apparatus 12, a data management program 12 a, a reportcreation program 12 b, an inspection image display control program 12 cand the like are stored.

Furthermore, the storage apparatus 12 includes an inspection data savesection 12 d in which the inspection data is saved.

The data management program 12 a is a software program configured tomanage the uploaded inspection data.

The report creation program 12 b is a software program configured tocreate the inspection report of the inspection data selected by theuser.

The inspection image display control program 12 c is a software programconfigured to generate a screen on which the inspection data isdisplayed. An inspection data display screen G described later isgenerated by the inspection image display control program 12 c.

The inspection data save section 12 d is a storage region in which theuploaded inspection data is stored and saved.

The communication unit 13 is a circuit with which the server 5 performscommunication with external equipment through the network 3.

The inspection data stored in the inspection data save section 12 d ofthe server 5 can be accessed by the external equipment through thecommunication unit 13, in a predetermined security environment. In theembodiment, the network 3 includes communication networks such as a LANand WIFI, in addition to the internet 3 a.

Back to FIG. 1 , a tablet terminal 6 includes a processor 6 a such as aCPU. Furthermore, the tablet terminal 6 includes a display device 6 band an unillustrated wireless communication circuit. Therefore, theprocessor 6 a can execute a process corresponding to a command input bythe user.

Note that a smartphone 7 also includes a processor and a display devicesimilarly to the tablet terminal 6.

Accordingly, the data management program 12 a of the server 5 reads theinspection data, in response to a data request command from externalequipment such as the endoscope apparatus having the communicationfunction, the tablet terminal 6, the smartphone 7 or the PC. Theinspection image display control program 12 c generates display data forthe inspection data display screen G, using the read inspection data.The data management program 12 a sends the display data to the externalequipment that has sent the data request command.

That is, when the user wants to watch the inspection data registered onthe cloud 5 a, the user can access a data management screen on the cloud5 a from anywhere, and can watch the inspection data.

For example, the user accesses a predetermined data management screen onthe cloud 5 a, and causes the data management program 12 a to display aninspection data list on a display apparatus of the external equipmentsuch as the tablet terminal 6. In the inspection data list, pluralpieces of inspection data are arrayed and displayed in a list form. Eachpiece of inspection data included in the inspection data list includesinformation such as the inspection ID, the inspection object, the serialnumber and an inspection day, by which the inspection data registered inthe server 5 is specified.

When the user selects a piece of inspection data from the displayedinspection data list, a data request command for requesting theinspection data is sent to the server 5.

When the user designates a certain inspection ID in the inspection datalist to send the data request command from a terminal apparatus such asthe tablet terminal 6 to the server 5 on the cloud 5 a, the datamanagement program 12 a reads the inspection data designated in the datarequest command and sends the inspection data to the external equipment.

The inspection data selected from the inspection data list, for example,is image information obtained in an inspection that is performed on acertain date and time for an inspection object specified by the serialnumber or the like.

As described above, the user can upload the inspection data obtainedusing the endoscope apparatus 2, to the server 5 on the cloud 5 a, andcan refer to the registered inspection data.

Further, using the external equipment, the user can edit the inspectiondata, and can create the inspection report of the inspection data.

Here, an example of a plurality of inspection sites in the inspectionobject will be described.

FIG. 3 is a diagram for describing inspection sites of an inspectionobject. FIG. 3 shows a configuration of a gas turbine engine forelectric power generation. The gas turbine engine as the inspectionobject 4 includes a compressor CM configured to compress intake air, aburning machine BM configured to inject fuel to a high-pressure gas fromthe compressor CM and burn the fuel, and a turbine TM configured to takeout dynamic power of rotation of a rotating shaft RM using ahigh-temperature and high-pressure gas that has passed through thecompressor CM and the burning machine BM.

Each inspection site is one inspection unit. In the embodiment, thecompressor CM is divided into three inspection units, and each of theburning machine BM and the turbine TM becomes one inspection unit.

The user that is the inspector inserts the insertion portion 2 a of theendoscope apparatus 2 into the gas turbine engine, and inspects eachinspection site of the gas turbine engine. The user can record theendoscope image obtained during the inspection, in the storage medium 2c, as the inspection data.

The inspection data is stored in a folder for each inspection site ofthe inspection object. The inspection object includes the plurality ofinspection sites, and the endoscope image is stored in a foldercorresponding to an inspection site for which the endoscope image isphotographed.

A plurality of folders is previously determined and set by the user orthe like, for each inspection object. A configuration of the pluralityof folders is previously determined by the user or the like, dependingon a configuration or structure of the inspection object. Theconfiguration or structure of the inspection object differs depending ona model, a model number and the like of the turbine engine that is theinspection object, and therefore, the user designates a plurality offolders corresponding to the inspection object to be inspected, and thenperforms the inspection.

During the inspection, the user designates the folder corresponding tothe inspection site, and then performs the recording of the endoscopeimage. For example, when the user selects a command such as a recordingbutton after the user selects the folder designating the inspectionsite, the user can record the endoscope image in the selected folder.

After the inspection of a certain inspection site finishes, the userdesignates the folder corresponding to a next inspection site, and thenperforms the inspection of the next inspection site. The endoscope imageis stored in the designated folder.

FIG. 4 is a diagram showing a folder tree structure of the plurality offolders in which the inspection data is stored.

The folder configuration is determined depending on the configuration orstructure of the inspection object. In the embodiment, one folder isprovided for one inspection site, that is, one inspection unit. In theembodiment, five folders correspond to five inspection sites into whichthe gas turbine engine is previously divided. For example, before theinspection, the user downloads folder configuration information from theserver 5, and stores the folder configuration information in the storagemedium 2 c.

Therefore, the folder configuration of storing the inspection data iscreated, for example, depending on the model number, model or serialnumber of the gas turbine engine. The plurality of folders having thefolder configuration is stored in the storage medium 2 c. Informationabout the plurality of folders having the folder configuration isacquired from an exterior, together with later-described imageinformation about a model showing the configuration of the inspectionobject, and is previously stored in the storage medium 2 c.

Here, for ease of description, an example in which the inspection unitsof the inspection object are respective inspection units A1 to A5 of theturbine engine shown in FIG. 3 will be described. The folder tree inFIG. 4 includes a folder F1 and five folders F11 to F15 provided at alower hierarchy of the folder F1.

Note that the plurality of folders may further include one or morefolders at lower hierarchies of the respective folders F11 to F15 asshown by doted lines in FIG. 4 .

When each inspection site is one inspection unit, one or more endoscopeimages photographed in the inspection site are stored in one foldercorresponding to the inspection site.

When the user inspects the inspection site A1 of the inspection object,the user previously selects or designates the folder F11 in the storagemedium 2 c, as a storage location for the inspection data. Theinspection data of the endoscope image picked up by the user is storedin the selected or designated folder F11, after a predetermined filename described later is given.

When the user inspects the next inspection site A2 after the inspectionof the inspection site A1 finishes, the user previously selects ordesignates the folder F12, as a storage location for the inspectiondata. Thereafter, the inspection data of the endoscope image picked upby the user is stored in the selected or designated folder F12, after apredetermined file name is given.

Subsequently, similarly, the user previously selects or designates thestorage location for the inspection data, and then acquires theendoscope image, so that the inspection data of the acquired endoscopeimage is stored in the selected or designated folder.

The user watches the endoscope image displayed on the monitor of theendoscope apparatus 2, gives evaluation information, and records theendoscope image.

For example, when some kind of defect is found in a certain inspectionsite within the inspection object, the user can freeze the endoscopeimage of the inspection site to photograph the still image, and canrecord information of an inspection evaluation result about theinspection site, in association with the endoscope image.

Examples of states of the inspection site include a variety of statessuch as a state where replacement of a component is needed, a statewhere fixing of a component is needed, a state where repair is notneeded but check is needed at a next inspection, and a state of noproblem. When the user records the endoscope image, the user can storeevaluation information about the state of the inspection site in thestorage medium 2 c, such that the evaluation information is associatedwith the inspection data of the endoscope image or such that theevaluation information is included in the inspection data.

For example, as described in Japanese Patent Application Laid-OpenPublication No. 2015-66236, the evaluation information may be includedin the file name of the inspection data.

FIG. 5 is a diagram showing a configuration example of a file name thatincludes the evaluation information.

A file name 21 includes folder information 22 in which the inspectiondata is stored, a file mark 23 as the evaluation information, and aportion 24 showing a sequential number.

The folder information 22 includes a folder name in the folder structureshown in FIG. 4 . When the folder tree structure has two or morehierarchies as shown by the dotted lines in FIG. 4 , the folderinformation 22 includes folder names of a plurality of hierarchies forspecifying the folder in which the image data is stored.

The file mark 23 indicates the inspection evaluation result. The filemark 23 is inspection result information that is configured by acharacter indicating an inspection result. The inspection resultinformation is information about a judgement result that the user judgesin an endoscope inspection. For example, when the file mark 23 in thefile name is “A”, the file name means that the user has judged that theportion of the inspection site seen on the endoscope image is “noproblem”. When the file mark 23 in the file name is “B”, the file namemeans that the user has judged that the portion of the inspection siteseen on the endoscope image is “replacement needed”, which indicatesthat the replacement of the component is needed. When the file mark 23in the file name is “C”, the file name means that the user has judgedthat the portion of the inspection site seen on the endoscope image is“fixing needed”. When the file mark 23 in the file name is “D”, the filename means that the user has judged that the portion of the inspectionsite seen on the endoscope image is “re-inspection needed”.

For example, the user inputs the file mark 23 when the user records theinspection data of the endoscope image, so that the file mark 23 iswritten.

The sequential number is identification information. When the endoscopeimage is recorded in the folder for the first time, the portion 24showing the sequential number shows “001”. Thereafter, whenever theendoscope image is added, the sequential number is incremented by “1”.

Furthermore, a portion for an extension such as “jpg”, which is acharacter string for identifying the type of the file, is added to thefile name.

Further, when the user records the inspection data, the user can add acomment. The user can cause an unillustrated comment input window to bedisplayed, can input an arbitrary comment as text data, and can storethe comment in association with the inspection data.

Therefore, when the user inspects the inspection object, the user storesfolders having a folder tree structure set depending on the inspectionobject, in the storage medium 2 c, and then starts the inspection. Theuser observes the respective inspection sites of the inspection object,picks up a necessary inspection site during the observation, and recordsthe endoscope image in the storage medium 2 c. When the user recordseach endoscope image, the user selects the file mark as the evaluationinformation, in the embodiment. In this way, the endoscope image foreach site is recorded in the storage medium 2 c, as the inspection data.

When the inspection finishes, the inspection data has been stored in thestorage medium 2 c of the endoscope apparatus 2. After the inspection,the user uploads the inspection data to the server 5 on the cloud 5 a.As described above, the upload is performed, for example, by sending theinspection data from the endoscope apparatus 2 or the tablet terminal 6to the server 5 through the network 3.

Since the inspection of the inspection object is performed usingidentification information such as the serial number of the inspectionobject, inspection identification information, that is, the inspectionID is specified, and the inspection data is uploaded to the server 5, sothat the inspection data is registered in the server 5 so as to belinked with the inspection object.

As described above, the uploaded inspection data is data stored in aplurality of folders in a folder tree that is previously set dependingon the configuration of the inspection object 4. The inspection dataincludes one or more endoscope images for each inspection site and thefile mark for the inspection site in each endoscope image.

Further, as described later, the user can create the inspection reportusing the inspection data on the cloud 5 a. Then, together with theinspection data, the created inspection report is saved in the server 5,in association with the inspection data.

As described above, plural pieces of inspection data for the inspectionobject are stored on the cloud 5 a, and each piece of inspection data isstored in accordance with a previously determined folder configuration.

(Operation)

The user can perform various processes, to the inspection dataaccumulated in the server 5 on the cloud 5 a. For example, the userperforms processes such as the check of the inspection data uploaded inthe server 5 and the creation of the inspection report.

FIG. 6 is a flowchart showing an example of a flow of a process in theterminal apparatus that is used by the user.

First, the user operates the terminal apparatus such as the endoscopeapparatus 2, the tablet terminal 6 or the smartphone 7, and accesses aninspection data management site on the cloud 5 a. The inspection datamanagement site is provided in the server 5. A case where the terminalapparatus is the tablet terminal 6 will be described below.

The user accesses a predetermined site, and thereby a menu screen isdisplayed on a screen of the tablet terminal 6. The user can watch oredit desired inspection data by inputting a desired command from themenu screen.

FIG. 6 is a flowchart showing an example of a flow of a process in thetablet terminal 6 when the user inputs various commands such as the datarequest command. When the user accesses a predetermined site in theserver 5 from the tablet terminal 6, a graphical user interface(hereinafter, referred to as GUI) screen such as a menu screen isdisplayed on the display device 6 b. The process in FIG. 6 is executedby an operation on the menu screen by the user.

In FIG. 6 , the processor 6 a of the tablet terminal 6 judges whether acommand for the inspection data has been inputted (step (hereinafter,abbreviated to S) 1). The display device 6 b includes a touch panelapparatus, and through the GUI screen displayed on the display device 6b, the user can input various commands on the GUI screen.

When the command for the inspection data has not been inputted (S1: NO),the processor 6 a does not perform anything.

When the command for the inspection data has been inputted (S1: YES),the processor 6 a sends the inputted command to the server 5 (S2).

For example, the user selects an object in the inspection data listdisplayed on the screen, and touches an operation button of a GUIcomponent displayed on the menu screen, so that the data request commandis sent to the server 5. The inspection request command includes theinspection ID and the like. The server 5 extracts the designatedinspection data based on the data request command, and sends the imagedata including the inspection data, to the tablet terminal 6.

After the sending of the command, the processor 6 a receives the imagedata corresponding to the command, and executes a display process ofdisplaying the image data on the display device 6 b (S3).

After S3, back to the process of S1, the processes of S1 to S3 arerepeated, and thereby the user can perform a desired process.

FIG. 7 is a flowchart showing an example of a flow of a process in theserver 5 corresponding to the data request command for the inspectiondata from the tablet terminal 6.

As described above, from the tablet terminal 6, the user designates theinspection ID, and sends the data request command for the inspectiondata. The model number of the gas turbine engine as the inspectionobject, the serial number, the inspection day and the like are specifiedby the inspection ID.

The server 5 judges whether the data request command for the inspectiondata has been received (S11). When the data request command for theinspection data has not been received (S11: NO), the server 5 does notperform any process.

When the data request command for the inspection data has been received(S11: YES), the server 5 executes a generation process for the screendata (S12). The server 5 reads the inspection data related to the datarequest command, from the inspection data save section 12 d of thestorage apparatus 12, and generates the screen data (S2). Aconfiguration of a screen to be generated in S12 will be describedlater.

The server 5 sends the screen data for the generated screen, to thetablet terminal 6 (S13). The screen data is image data by which a screenhaving a later-described screen configuration is displayed on thedisplay device 6 b of the tablet terminal 6. As a result, a screen witha predetermined configuration is displayed on the display device 6 b ofthe tablet terminal 6.

The screen displayed on the tablet terminal 6 is a GUI screen asdescribed later, and the user can send desired commands to the server 5and can request further process executions to the server 5, by operatingvarious operation buttons and the like on the GUI screen.

Note that the server 5 ends the process about the screen displayed onthe display device 6 b when the user operates a predetermined endbutton.

The screen displayed on the display apparatus of the terminal apparatusis a screen generated in the server 5, and has a configuration shown inFIG. 8 .

FIG. 8 is a diagram showing a configuration of an inspection datadisplay screen that is displayed on the tablet terminal 6 based on theimage data received from the server 5.

In the embodiment, an inspection data display screen G includes threedisplay regions G1, G2, G3.

In the first display region G1, an image showing the configuration ofthe inspection object (hereinafter, referred to as an image of themodel) is displayed.

In the second display region G2, the inspection data for at least oneinspection site selected in the first display region G1 is displayed.The inspection data includes the endoscope image that is an inspectionimage.

In the third display region G3, the inspection data relevant to theinspection object displayed on the first display region G1 is displayed.The inspection data displayed in the third display region G3 is theinspection data prior to the inspection data displayed in the seconddisplay region G2. The prior inspection information is also stored inthe server 5. The inspection data in the third display region G3 isdisplayed together with the first display region G1 and the seconddisplay region G2.

As described later, the inspection data display screen G is a GUIallowing the user to input various commands in addition to presentationof information. Therefore, the user can send desired various commands tothe server 5, by selecting operation buttons, checkboxes and the like onthe inspection data display screen G. A specific example of theinspection data display screen G will be described later.

In the embodiment, in the inspection data display screen G, the seconddisplay region G2 is arranged under the first display region G1, and thethird display region G3 is arranged on a right side of the first displayregion G1 and the second display region G2. Note that the three displayregions may be arranged at positions other than the arrangement shown inFIG. 8 .

Back to FIG. 7 , the server 5, after S13, executes various processescorresponding to various commands sent through the inspection datadisplay screen G that is a GUI (S14).

The various processes in S14 include filtering for narrowing the displaydata, the creation of the inspection report using the selectedinspection data, the edit of the inspection data, and the like. Thecreation of the inspection report is performed by the report creationprogram 12 b. Therefore, for example, the user can create the inspectionreport, can register the created inspection report in the server 5, andcan register the inspection data after the edit in the server 5. In theserver 5, the created inspection report is stored in the inspection datasave section 12 d of the storage apparatus 12, in association with theinspection data related to the data request command. In the server 5,the inspection data related to the data request command is changed tothe inspection data after the edit.

FIG. 9 is a diagram showing a specific configuration example of theinspection data display screen G.

The inspection data display screen G includes a title display portion 31configured to display an inspection object name, at an upper portion. Inthe title display portion 31, information such as the model number,serial number and inspection ID of the inspection object for theinspection data to be displayed on the inspection data display screen Gis displayed.

The first display region G1 includes a model image display portion 32configured to display an image of the model showing the configuration ofthe inspection object. The image of the model is an external view, asectional view or the like showing the configuration of the inspectionobject. In FIG. 9 , a schematic sectional view of the gas turbine engineis displayed as the image of the model, in the model image displayportion 32.

Note that the image of the model to be displayed in the model imagedisplay portion 32 may be a schematic diagram as shown in FIG. 9 but maybe a figure generated by a photograph or a 3D model, a CAD figure or thelike.

Furthermore, the first display region G1 includes region specifyingportions 33 configured to indicate ranges of the respective inspectionsites of the inspection object. In FIG. 9 , the region specifyingportions 33 are a plurality of two-dot chain lines. In the embodiment,one inspection site is a region that is marked off by two two-dot chainlines.

Further, the first display region G1 includes a region name displayportion 34 configured to display region names of the respectiveinspection sites. In the embodiment, the region name display portion 34includes region names of the five inspection sites A1 to A5. “A1” to“A5” are displayed so as to correspond to the five inspection sites A1to A5 specified by the region specifying portions 33.

Note that the region name display portion 34 also includes a display“ALL” indicating selection of all regions.

Furthermore, the first display region G1 includes a plurality ofcheckboxes 35 for selecting the respective inspection sites. In theembodiment, six checkboxes 35 are provided so as to correspond to thefive inspection sites A1 to A5 and “ALL” indicating all regions. Therespective checkboxes 35 are arranged close to the respective regionnames in the region name display portion 34.

The user can put check marks on one or more checkboxes 35 displayed onthe display device 6 b, by touching the checkboxes 35. By putting thecheck marks, the user can select the inspection sites corresponding tothe checkboxes 35 on which the check marks are put.

The second display region G2 includes an inspection data display region41 configured to display one or more pieces of inspection data. Theinspection data to be displayed in the second display region G2 is theinspection data that is designated in the data request command by theuser.

Each piece of inspection data to be displayed in the inspection datadisplay region 41 includes an image display region 42, a file namedisplay portion 43, a comment display portion 44 and a date displayportion 45.

Note that the inspection data indicated by an arrow D in FIG. 9 ismoving image data.

In the image display region 42, a reduced endoscope image in theinspection data is displayed.

In the file name display portion 43, a whole or a part of the file nameof the endoscope image displayed in the image display region 42 isdisplayed.

In the comment display portion 44, if a comment is inputted by the user,a whole or a part of the comment is displayed.

In the date display portion 45, a date when the endoscope imagedisplayed in the image display region 42 was photographed is displayed.That is, the inspection day of the inspection object is displayed.

Furthermore, checkboxes 46 are added to the respective inspection data.In FIG. 9 , the respective checkboxes 46 are provided so as to be closeto or adjacent to the image display regions 42.

The user can put check marks on the checkboxes 46 displayed on thedisplay device 6 b, by touching the checkboxes 46. By putting the checkmarks, the user can select the inspection data corresponding to thecheckboxes 46 on which the check marks are put.

Furthermore, in the second display region G2, a command designationportion 47 is provided. The command designation portion 47 is a combobox, and the user can cause a plurality of commands to be displayed andcan select a desired command from the plurality of commands byperforming drop-down using a cursor.

Further, in the second display region G2, a scroll bar 48 is provided,and the user can change a display position in the second display regionG2, using the scroll bar 48.

For example, when the user selects an inspection site in the image ofthe model displayed in the first display region G1, the inspection datafor the inspection site selected in the first display region G1 isdisplayed in the second display region G2.

In FIG. 9 , in the first display region G1, two regions are selectedfrom the five inspection sites, and thereby in the second display regionG2, the inspection data for the two inspection sites selected in thefirst display region G1 is displayed.

When the user wants to cause the inspection data for another inspectionsite to be displayed, the user selects the other inspection site fromthe five inspection sites, and thereby can cause the inspection data forthe other inspection site to be displayed in the second display regionG2.

When the user wants to cause the inspection data for all inspectionsites to be displayed, the user puts a check on the checkboxcorresponding to “ALL”, and thereby the user can cause the inspectiondata for all inspection sites to be displayed in the second displayregion G2.

As described above, first inspection information to be displayed in thesecond display region G2 includes an image relevant to at least oneinspection site that is selected in the first display region G1.

Note that when no inspection site is selected in the first displayregion G1, all pieces of the inspection data about the inspectionobject, for example, are displayed in a file name order in the seconddisplay region G2 as a default. That is, when the inspection datadisplay screen G is displayed for the first time or when no inspectionsite is selected, information that is set as the default and that isnarrowed in a predetermined condition is displayed as the firstinspection information, in the second display region G2.

For example, the predetermined condition is specified by the evaluationinformation (A, B, C, D) such as the file mark added to the inspectiondata, which is included in the first inspection information to bedisplayed in the second display region G2. Alternatively, thepredetermined condition is specified by date information of theinspection data, which is included in the first inspection informationto be displayed in the second display region G2.

The user can perform a desired process, to the inspection data displayedin the second display region G2. An instruction of execution of thedesired process can be given by selecting a desired command in thecommand designation portion 47.

For example, when the user selects a command for report creation as thedesired command, the user can send, to the server 5, a creationinstruction command for an inspection report about one or more pieces ofinspection data selected with the checkboxes 46 in the second displayregion G2. Alternatively, when the command for report creation isselected, an inspection report about one or more inspection sites thatare selected from the plurality of inspection sites displayed in thefirst display region G1 is created by the report creation program 12 b.

That is, the processor creates the inspection report, based on theinspection information for one or more inspection sites that areselected from the plurality of inspection sites displayed in the firstdisplay region G1 or one or more pieces of inspection information thatare selected from the first inspection information displayed in thesecond display region G2.

As a result, the server 5 creates the inspection report using apredetermined template, and stores the inspection report in the storageapparatus 12 d. The user can separately refer to the stored report fromthe tablet terminal 6.

As described above, the inspection data relevant to the model displayedin the first display region G1 and prior to the inspection datadisplayed in the second display region G2 is displayed in the thirddisplay region G3.

In FIG. 9 , two inspection sites A1, A2 are selected in the firstdisplay region G1, and therefore, the prior inspection data relevant tothe two inspection sites is displayed in the third display region G3.

In the third display region G3, all of the prior inspection datarelevant to the model displayed in the first display region G1 may bedisplayed, but in the embodiment, only the prior inspection dataselected based on the evaluation information with the file mark isdisplayed.

For example, when pieces of inspection data on a plurality of priordates are stored in the inspection data save section 12 d as theinspection data relevant to the two selected inspection sites, a pieceof inspection data having a lowest evaluation and a latest inspectiondate is selected from the prior data pieces, and is displayed in thethird display region G3.

The inspection data to be displayed in the third display region G3includes an image display region 51, a file name display portion 52, acomment display portion 53 and a date display portion 54, similarly tothe inspection data in the second display region G2.

Further, in the third display region G3, a scroll bar 55 is provided,and the user can change a display position in the third display regionG3, using the scroll bar 55.

FIG. 10 is a flowchart showing an example of a flow of the generationprocess (S12) for the image data in FIG. 7 .

When the server 5 receives the data request command for the inspectiondata, the server 5 generates the image for the first display region G1(S21). In S21, the server 5 generates an image that is relevant to theinspection data specified by the data request command and that is shownin the first display region G1 shown in FIG. 9 .

The image to be shown in the first display region G1 includes the modelimage display portion 32, the region specifying portion 33, the regionname display portion 34 and the plurality of checkboxes 35.Particularly, in the model image display portion 32, the image of themodel of the inspection object is displayed.

That is, in the process of S21, the image of the model of the inspectionobject including a plurality of inspection sites is displayed in thefirst display region G1 on the display device 6 b of the tablet terminal6.

The server 5 extracts the inspection data about the inspection siteselected with the checkbox 35 in the first display region G1 (S22). Theserver 5 extracts the inspection data about the selected inspectionsite, from the inspection data stored in the inspection data savesection 12 d.

After S22, the server 5 generates the image for the second displayregion shown in FIG. 9 , using the extracted inspection data (S23).

That is, in the process of S23, the first inspection informationrelevant to at least one inspection site that is selected from theplurality of inspection sites in the image of the model displayed in thefirst display region G1 is displayed in the second display region G2 onthe display device 6 b of the tablet terminal 6.

Further, after S21, the server 5 extracts the prior inspection dataabout the inspection site selected with the checkbox 35 in the firstdisplay region G1, in a predetermined condition (S24). The server 5extracts the inspection data about the inspection site selected with thecheckbox 35, from the prior inspection data for the inspection objectthat is stored in the inspection data save section 12 d, in apredetermined condition.

The extraction condition in S24 is previously set, and the setting canbe changed by the user. For example, the extraction condition is theextraction of the inspection data having the lowest evaluation and thelatest inspection date in the prior data as described above.

Note that the server 5, in S24, may extract the prior inspection dataabout the inspection data selected with the checkbox 46 in the seconddisplay region G2, in a predetermined condition.

For example, when each piece of inspection data includes positionalinformation in the inspection site, the extraction condition is theextraction of the inspection data for a position close to a position ofthe inspection data selected with the checkbox 46 in the second displayregion G2.

That is, second inspection information to be displayed in the thirddisplay region G3 may include an image of a portion close to a portionof the inspection object seen on an image that is included in theinspection information selected in the second display region G2.

As a result, the user can watch the prior inspection data for a vicinityof a position where the image of the selected inspection data wasphotographed.

After S24, the server 5 generates the image for the third display regionG3 shown in FIG. 9 , using the extracted prior inspection data (S25).

That is, in the process of S25, the inspection information prior to thefirst inspection information is displayed as the second inspectioninformation relevant to the model of the inspection object, in the thirddisplay region G3 on the display device 6 b of the tablet terminal 6.

After S23 and S25, the server 5 generates the inspection data displayscreen G shown in FIG. 9 , by synthesizing the images for the threedisplay regions generated in S21, S23 and S25 (S26).

By S26, the inspection data display screen G shown in FIG. 9 isgenerated, and is sent to the tablet terminal 6. On the tablet terminal6, the inspection data display screen G shown in FIG. 9 is displayed.That is, in the process of S26, the inspection information prior to thefirst inspection information is displayed in the third display regionG3, concurrently with the first display region G1 and the second displayregion G2.

In FIG. 9 , the second inspection information to be displayed in thethird display region G3 includes the image relevant to at least oneinspection site that is selected in the first display region G1.

In the case of FIG. 9 , when pieces of inspection data at a plurality ofprior time points are stored in the inspection data save section 12 d asthe inspection data relevant to the two inspection sites A1, A2, a pieceof inspection data having the latest date is selected from pieces ofinspection data having the lowest evaluation in the prior data pieces,and is displayed in the third display region G3.

That is, the second inspection information to be displayed in the thirddisplay region G3 includes an image that is a latest image in the priorinspection information and to which an evaluation equal to or lower thana predetermined level is given in predetermined evaluation information.

Since the piece of inspection data having the latest date and the lowestevaluation in the prior data pieces is displayed in the third displayregion G3, the user, in the inspection, can perceive an inspection siteto which most attention should be paid, can surely inspect a spot inquestion, and can properly perform the evaluation. Particularly, sincethe evaluation information is included in the inspection data, the usercan perform the evaluation in the inspection, by reference to lastevaluation information, and can perform a feedback for a lastevaluation.

Note that the second inspection information to be displayed in the thirddisplay region G3 may include an image that is selected from the priorinspection information based only on predetermined evaluationinformation such as the file mark. Particularly, the third inspectioninformation may include only an image to which an evaluation equal to orlower than a predetermined level in evaluation results indicated by thefile mark is given.

Furthermore, note that the second inspection information may include animage containing a defect region that has been judged and recorded as adefect in the first display region G1. Whether the image contains thedefect region can be judged, for example, by the file mark.

Further, the second inspection information to be displayed in the thirddisplay region G3 may be the latest image in the prior inspectioninformation.

Furthermore, the second inspection information to be displayed in thethird display region G3 may be an image that is extracted from theinspection report relevant to the inspection object in a predeterminedcondition. For example, when a plurality of inspection reports exists,an image of inspection data having a worst evaluation result in a latestinspection report may be displayed in the third display region G3.

Note that the inspection data display screen G may contain a fourthdisplay region G4 in which a prior inspection report is displayed.

FIG. 11 is a diagram showing a specific configuration example of theinspection data display screen G that contains the fourth display regionG4.

The inspection data display screen G shown in FIG. 11 has the fourthdisplay region G4 at a lower right portion of the inspection datadisplay screen G.

In the fourth display region G4, a content of the prior inspectionreport itself or an image in the inspection report that is extracted ina predetermined condition is displayed. In the fourth display region G4,a scroll bar 55A is provided, and the user can change a display positionin the fourth display region G4, using the scroll bar 55A.

For example, in the case of FIG. 11 , when a plurality of inspectionreports at a plurality of prior time points is stored in the inspectiondata save section 12 d as inspection reports relevant to the twoinspection sites A1, A2, an inspection report having the latest date isselected from the prior inspection reports, and is displayed in thefourth display region G4.

That is, the user may cause the processor of the server 5 to display animage extracted from the inspection report relevant to the inspectionobject, in the fourth display region G4.

Since the user can watch the prior inspection reports as necessary, theuser can evaluate the inspection of the inspection object that the useris currently inspecting, while comparing inspection results in the priorinspection reports.

Note that the fourth display region G4 may be arranged at a positionaway from the third display region G3 or may be arranged within thethird display region G3 although the fourth display region G4 isarranged so as to be adjacent to the third display region G3 in FIG. 11.

Furthermore, note that only link information for referring to the priorinspection report may be displayed in the fourth display region G4although the content of the prior inspection report is displayed in thefourth display region G4 in FIG. 11 .

For example, when the user touches and selects a link informationportion, the image extracted from the prior inspection report in apredetermined condition is displayed in a pop-up window or the like.That is, the image extracted from the inspection report may be displayedwhen the link information displayed in the third display region G3 isselected.

As described above, according to the above-described embodiment, it ispossible to provide an inspection image display control method, aninspection image display control apparatus and an inspection imagedisplay control system that allow the user to easily refer to the priorinspection information relevant to a certain inspection when theinformation about the certain inspection is displayed.

As a result, the user can perform the evaluation of the inspection whilewatching the inspection data with a prior problem, and therefore canreduce variation in the evaluation of the inspection data.

Further, when the inspection data having a low evaluation in the priorinspection is displayed in the third display region G3, it is possibleto prevent the user from missing the inspection data with the priorproblem.

Furthermore, the above-described embodiment is convenient because theinspection data is stored in the server 5 on the cloud 5 a and the usercan perform various processes such as data edit and report creation onthe cloud 5 a.

In the above-described embodiment, the server 5, which executes theprocess in FIG. 10 , configures the inspection image display apparatusthat causes the display device of the external equipment to display theinspection data display screen G, but some of the process in FIG. 10 maybe executed by the external equipment such as the tablet terminal 6.

Note that the inspection object may be engines for aircrafts, variousfacilities in factories and the like although the gas turbine engine forelectric power generation has been described as an example of theinspection object in the above-described embodiment.

Furthermore, in the above-described embodiment, the inspection using theendoscope apparatus has been described, but the above-describedembodiment can be applied also to an inspection using an inspectionapparatus other than the endoscope apparatus, as exemplified by anultrasound inspection apparatus that outputs an ultrasound image.

The present invention is not limited to the above-described embodiment,and various modifications, improvements and the like can be made in arange in which the spirit of the present invention is not changed.

What is claimed is:
 1. A method, implemented by a processor, the methodcomprising: controlling a display to display an image of an inspectionobject including a plurality of inspection sites in a first displayregion of a display screen of the display; determining that aninspection site has been selected from the plurality of inspectionsites; extracting first inspection information corresponding to theselected inspection site based at least in part on the determinationthat the inspection site has been selected, inspection information inwhich the first inspection information is included being stored in oneof a plurality of folders corresponding to the plurality of inspectionsites, the first inspection information being included in a first foldercorresponding to the selected inspection site; extracting secondinspection information corresponding to the selected inspection sitebased at least in part on the determination that the inspection site hasbeen selected, the second inspection information having been generatedprior to the first inspection information, inspection information inwhich the second inspection information is included being stored inanother one of the plurality of folders corresponding to the pluralityof inspection sites, the second inspection information being included ina second folder corresponding to the selected inspect site, the secondfolder being generated before the first folder is generated; controllingthe display to display the first inspection information in a seconddisplay region of the display screen; and controlling the display todisplay the second inspection information in a third display region ofthe display screen, the first inspection information and the secondinspection information being displayed concurrently in the displayscreen in the second display region and the third display region.
 2. Themethod according to claim 1, wherein the second inspection informationincludes an image that is a latest image in the inspection informationthat was generated prior to the first inspection information and towhich an evaluation equal to or lower than a predetermined level isgiven in predetermined evaluation information.
 3. The method accordingto claim 1, wherein the second inspection information includes an imagethat is selected from the inspection information that was generatedprior to the first inspection information based on predeterminedevaluation information.
 4. The method according to claim 3, wherein thesecond inspection information includes an image to which an evaluationequal to or lower than a predetermined level is given in thepredetermined evaluation information.
 5. The method according to claim1, wherein the second inspection information includes an image thatcontains a defect region in the selected inspection site.
 6. The methodaccording to claim 1, wherein the second inspection information includesa latest image in the inspection information that was generated prior tothe first inspection information.
 7. The method according to claim 1,wherein the second inspection information includes an image that isextracted from an inspection report corresponding to the inspectionobject.
 8. The method according to claim 7, comprising, when linkinformation displayed in the third display region is selected,controlling the display to display the image extracted from theinspection report corresponding to the inspection object.
 9. The methodaccording to claim 1, further comprising controlling the display todisplay an image that is extracted from an inspection reportcorresponding to the inspection object, in a fourth display region. 10.The method according to claim 1, wherein the first inspectioninformation includes an image corresponding to the selected inspectionsite.
 11. The method according to claim 1, wherein the first inspectioninformation is information that is narrowed in a predeterminedcondition.
 12. The method according to claim 11, wherein thepredetermined condition is specified by evaluation information that isincluded in the first inspection information.
 13. The method accordingto claim 11, wherein the predetermined condition is specified by dateinformation that is included in the first inspection information. 14.The method according to claim 1, further comprising creating aninspection report based on the selected inspection site or on a piece ofinspection information that is selected from the first inspectioninformation displayed in the second display region.
 15. The methodaccording to claim 1, wherein the second inspection information isstored in a server that is connected with a network.
 16. The methodaccording to claim 1, wherein: determining that the inspection site hasbeen selected from the plurality of inspection sites comprisesdetermining that at least two inspection sites have been selected;extracting the first inspection information corresponding to theselected inspection site based at least in part on the determinationthat the inspection site has been selected comprises extracting firstinspection information corresponding to each of the at least twoselected inspection sites; and controlling the display to display thefirst inspection information in the second display region of the displayscreen comprises controlling the display to display the first inspectioninformation corresponding to each of the at least two selectedinspection sites in the second region of the display screen.
 17. Themethod according to claim 1, wherein: determining that the inspectionsite has been selected from the plurality of inspection sites comprisesdetermining that at least two inspection sites have been selected;extracting the second inspection information corresponding to theselected inspection site based at least in part on the determinationthat the inspection site has been selected comprises extracting secondinspection information corresponding to each of the at least twoselected inspection sites; and controlling the display to display thesecond inspection information in the third display region of the displayscreen comprises controlling the display to display the secondinspection information corresponding to each of the at least twoselected inspection sites in the third region of the display screen. 18.The method according to claim 1, further comprising: setting theplurality of folders; setting at least one folder of the plurality offolders; and recording the image of the inspection object after settingthe at least one folder, to store the image of the inspection object inthe set folder, wherein recording of the image of the inspection objectis performed before displaying of the image of the inspection object inthe first display region.
 19. The method according to claim 18, whereinsetting the at least one folder comprises reading the first folderstored in advance and setting the first folder.
 20. An apparatuscomprising at least one processor, the at least one processor beingconfigured to: control a display to display an image of an inspectionobject including a plurality of inspection sites in a first displayregion of a display screen of the display; determine that an inspectionsite has been selected from the plurality of inspection sites; extractfirst inspection information corresponding to the selected inspectionsite based at least in part on the determination that the inspectionsite has been selected, inspection information in which the firstinspection information is included being stored in one of a plurality offolders corresponding to the plurality of inspection sites, the firstinspection information being included in a first folder corresponding tothe selected inspection site; extract second inspection informationcorresponding to the selected inspection site based at least in part onthe determination that the inspection site has been selected, the secondinspection information having been generated prior to the firstinspection information, inspection information in which the secondinspection information is included being stored in another one of theplurality of folders corresponding to the plurality of inspection sites,the second inspection information being included in a second foldercorresponding to the selected inspect site, the second folder beinggenerated before the first folder is generated; control the display todisplay the first inspection information in a second display region ofthe display screen; and control the display to display the secondinspection information in a third display region of the display screen,the first inspection information and the second inspection informationbeing displayed concurrently in the display screen in the second displayregion and the third display region.